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Abstract. We construct, in an essentially explicit way, various composition op- 
erators on H 2 and study their compactness or their membership in the Schatten 
classes. We construct: non-compact composition operators on H 2 whose sym- 
bols have the same modulus on the boundary o/D as symbols whose composition 
operators are in various Schatten classes S p with p > 2; compact composition 
operators which are in no Schatten class but whose symbols have the same mod- 
ulus on the boundary of D as symbols whose associated composition operators 
are in S p for every p > 2. 
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1 Introduction 

Compactness of composition operators on H 2 was first studied in 1968 by H. 
Schwartz in his doctoral dissertation [TO] , and refined in 1973 by J. Shapiro and 
P. Taylor [13], who discovered the role played by the classical angular derivative, 
and refined the compactness problem by asking which composition operators 
belong to various Schatten classes S p . In particular, they showed in [13] that 
C*0 G S2, the Hilbert-Schmidt class, if and only if / aD (l — < +00, where 

4>* denotes the radial limit function of 4>. In this paper, we show that for the 
larger class S p with p > 2, the situation is completely different: we prove in 
Theorem 14, 2^ that for every p > 2, there exist two symbols 4>\ and 4>2 having 
the same modulus on <9B and such that C < p 1 is not compact on H 2 , but G^ 2 is 
in the Schatten class S p . 

An amusing feature of the theory of composition operators is that, whereas 
sophisticated necessary and sufficient conditions for the composition operators 
C*0 : H 2 — ► H 2 to belong to the Schatten classes S p = S P (H 2 ) have been known 
for more than twenty years ([7], [H]); either in terms of the Nevanlinna counting 
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function, or in terms of the pull-back measure m^, yet explicit and concrete ex- 
amples are lacking. For example, D. Sarason posed in 1988 the question whether 
there existed a compact composition operator : H 2 — ► H 2 which was in no 
Schatten class, and the (affirmative) answer only came in 1991, by T. Carroll 
and C. Cowen ([!]). Their example, based on the Riemann mapping Theorem 
was not completely explicit. Moreover, their construction used a difficult and 
delicate argument, with estimates of the hyperbolic metric for certain domains, 
due to Hayman (see however [15] and [3]). We shall see in this paper that 
Luecking's criterion [7j for pullback measures leads to very concrete examples 
of composition operators in various Schatten classes. 

In Section [H we give a necessary condition, Proposition [331 on the Carleson 
function in order for the composition operator to be in S p , as well as a 
general construction of symbols <f> with control on their Carleson function. 

In Section [H we construct, for every p > 2, symbols <j>i and 02 having the 
same modulus on SO such that C$ x is not compact on H 2 , but C^ 2 is in the 
Schatten class S p (Theorem I4.2|) . 

In Section [U we revisit an example of J. Shapiro and P. Taylor ([13j. § 4) to 
show that for every po > 0, there exists a symbol (f> such that the composition 
operator C$\ H 2 — > H 2 is in the Schatten class S p for every p > p , but not 
in S po (Theorem 15 .ip . and also that for every p > 0, there exists a symbol <j) 
such that C<f,: H 2 — > H 2 is in the Schatten class S po , but not in S p , for p < p 
(Theorem 15 .4|) . Moreover, there exists a symbol <f> such that C$ : H 2 — > H 2 is 
compact but in no Schatten class S p for p < oo (Theorem 15. 6p and there exists 
a symbol whose boundary values i/)* have the same modulus as those 4>* of 
4> on SB, but for which C$: H 2 — > H 2 is in S p for every p > 2 (Theorem 15. 7p . 

After our work was completed, we became aware of the papers [H] and [3]; 
in [3], M. Jones gives another proof of the theorem of Carroll and Cowen (our 
Theorem 15. 6p . and Y. Zhu gives also another proof of this theorem, as well as a 
proof of our Theorem l5.ll However, our proofs are different and lead to further 
results: see Theorem 14.21 

Acknowledgements. We thanks the referee for a very careful reading of this 
paper and many suggestions to improve its writing. 

2 Notation 

Throughout this paper, the notation / w g will mean that there are two con- 
stants < c < C < +oo such that cf(t) < g{t) < Cf(t) (for t sufficiently near of 
a specified value), and the notation f(t) < g(t), when t is in the neighbourhood 
of some value to, will have the same meaning as g = 0(f). 

We shall denote by D the open unit disc of the complex plane: D = {z £ 
C; \z\ < 1}, and by T = dO its boundary: T = {z £ C ; \z\ = 1}. We shall 
denote by m the normalized Lebesgue measure on T. 

For every analytic self-map 4>: D — > D, the composition operator is the 
map f i — ► f o (j). By Littlewood's subordination principle (see [2], Theorem 1.7), 
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every composition operator maps every Hardy space H p (p > 0) into itself, and 
is continuous on H p . 

For every £ € T and < h < 1, the Carleson window /i) is the set 
W(£,h) = {zeB; \z\>l-h and | arg(z£)| < ft}. 
For every finite positive measure /i on B, one sets: 

Plt (h)=mpn\Wte,h)]. 

We shall call this function p M the Carleson function of p. 

When </>: D — > B is an analytic self-map of D, and p = is the measure 
defined on D, for every Borel set BCD, by: 

m (B)=m(UeT; <fi*(£) G £?}), 

where (f>* is the boundary values function of (f>, we shall denote p m , by p^. In 
this case, we shall say that p^ is the Carleson function of 4>. 

For a > 1, we shall say that /i is an a- Carleson measure if p^h) < ft". For 
a = 1, /x is merely said to be a Carleson measure. 

The Carleson Theorem (see [2], Theorem 9.3) asserts that, for 1 < p < oo 
(actually, for < p < oo), the canonical inclusion : — > L p {p) is bounded 
if and only if /i is a Carleson measure. Since every composition operator C<j, is 
continuous on H p , it defines a continuous map j^: H p — > L p (p^,); hence every 
pull-back measure /x^ is a Carleson measure. 

When C<f, : H 2 — > iJ 2 is compact, one has, as it is easy to see: 

(2.1) |0*| < 1 a.e. on <9D. 

Hence, we shall only consider in this paper symbols (j> for which l|2.ip is satisfied 
(which is the case, as we said, when is compact on H 2 ). 

B. MacCluer ([9], Theorem 1.1) has shown (assuming condition (|2.ip ) that 
Cij, is compact on H p if and only if p<f,(h) — o(h), as h goes to 0. 

Note that, in this paper, we shall not work, most often, with exact inequali- 
ties, but with inequalities up to constants. It follows that we shall not actually 
work with true Carleson windows W(£, h) (or Luecking sets, defined below), but 
with distorted Carleson windows: 

W(£, h) = {z e B; \z\ > 1 - ah and | arg(<)| < bh}, 

where a, b > are given constants. Since, for a given symbol (f), one has: 

m^W(^ch)) <m^(W^,h)) <m<f,(W{{,Ch)) 

for some constants c = c(a, b) and C — C(a, b) which only depend on a and b, 
that will not matter for our purpose. 
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3 Preliminaries 



3.1 Luecking sets and Carleson windows 

We shall begin by recalling the characterization, due to D. Luecking (0), of 
the composition operators on H 2 which belong to the Schatten classes. Let, for 
every integer n > 1 and < j < 2™ — 1: 

Rn tj = {zeB; 1 - 2-" < |z| < 1 - 2-"- 1 and ^ < argz < 2(j ± ^ } 

be the Luecking sets. 
The result is: 

Theorem 3.1 (Luecking [7]) -For every p > 0, the composition operator C§, 
assuming condition l|2.ip , is in the Schatten class S p if and only if: 

O.I) j2 2np/2 Ci:[ m ^Rn,)] p/2 )<+^ 

n>0 ^ j=Q ' 

Majorizing m (i?„j) by m lt> (W{e 2 " l(2 i +1 ^ 7T , 2~ n )) < p^{2~ n ), one gets: 

Corollary 3.2 Let cp: D — > D 6e an analytic self-map, with condition \2.1\ . 
and assume that is an a-Carleson measure, with a > 1. Tften S S p for 
every p > . 

Proof. Since p<f,(h) < h a , one gets: 

n>0 ^ j=0 ' n>0 n>0 

which is < +oo since 1 — (a — 1)§ < 0. □ 

In order to get this corollary, we majorized crudely m ! j ) (R n j) by p ! j ) (2^ n ). 
Actually, we shall see, through the results of this paper, that we lose too much 
with this majorization. Nevertheless, if we replace the Luecking sets by the 
dyadic Carleson windows: 

W nJ ={z€H; l-2-<W<l, !^<arg(z)<^±i^}, 

(j = 0, 1, . . . , 2 n — 1, n = 1, 2, . . .), we have the same behaviour: 

Proposition 3.3 Let fi be a finite positive measure on the open unit disk D and 
let a > 0. Then the following assertions are equivalent: 

oo 2"-l 

(«) E E 2" Q (M(i?n J )) Q < +oo; 

n=l j=0 
oo 2"-l 

(*) EE r (^)) a<+M - 

n=l j=Q 
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Proof. It is clear that (6) implies (a) since R n j C W n ,j for all n and j (we 
already used this in the proof of Corollary 13.2ft . 

For the proof of the converse implication, we shall need the following sets, 
for positive integers I, n with I > n, and j G {0, 1, ... , 2" — 1}: 

H ltn<j = {ke{0,l,...,2 l -1}; A<|<^±i}. 

It is clear that we have, for every n and j: 

W n,i = (J U R ^ 

l>n keH hnJ 

and 

M(Wn,i)=E E M^,*)- 

We shall first treat the case a < 1, where we can use, for Xi, x 2 , ■ ■ ■ , a; at > 0: 

(xi + x 2 H h xat)" < x? + x£ + Vx% . 

We have: 

oc 2 n — l oc 2 n — 1 y 

EE 2M («°=EE 2 "U E ' 

n=l j=0 n=l j=0 ^ Z>n keHi, n ,j 

oo 2"-l 

<EE r E E m*)) a 

n=l j=0 i>ri ke.Hi t „ t j 

oo 2 ! -l 

= EEWM Q E 2 " Q 

J=l fc=o (n,j):n<l;keHi, n j 

Observe that, for every n<l, there is only one j such that k 6 Hi,n,j- Since 
we have 

/ 

^2 nQ < C Q 2' a , 

we get: 

oo 2"-l oo 2 ! -l 

E e 2 " Q (M(w^)r < c«EE ^(M^, fc )) Q , 

n=l j=0 1=1 k=0 

and (a) implies (6) in the case a < 1. 

If a > 1, we can use Holder's inequality. Let /3 be the conjugate exponent 
of a. Choose a such that 1 < a < 2 < a 13 . Then: 

f*(Wnj) = E ^ R hk) 

<( E ^) ( E « h w.*)n 
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Using that \Hi, nij \ = 2 l ~ n , we get: 



11//3 



l>r 



oo 2™-l 



E ^ 

l>n : k£Hi n j 

Therefore we have: 

oo 2"-l 

^ E 2 na (n(W n ^)) a < E E 2" Q C>— 



(2a-^rv //3 



1 - 2a-$ 



a la (v(Ri,k)Y 



n=l j=0 



n=l j=0 

oo 2'-l 



^EEW"" E (w 

{=1 fc=0 (n,j):n<l,keB l: „ :j 
oo 2 ! -l 

<EE ( M (i^))V«(2/a)^ 



Z=l fc=0 
oo 2 ! -l 



=EE 2ia (M^))' 



We have hence proved that (a) implies (6) for a > 1 and therefore Proposition[ 
follows. □ 

As a corollary we prove a necessary condition that p$ must satisfy when C$ 
is in the Schatten class S p . 

Proposition 3.4 Let 4>: D — > D fee an analytic self-map. If the composition 
operator : H 2 — > i/ 2 is in £/ie Schatten class S p for some p > 0, then, as h 
goes to 0: 



(3.2) 



1 \ -2/P 

>(/l) = o ( h( log- 



Proof. Thanks to Luecking's characterization and the equivalence in Proposi- 
tion [33J we have, for the pullback mesure m$: 



(3.3) 



oo 2 n — 1 



Observe that, for h = 2 ™ each window W(£, h) is contained in the union of at 



most three of the W n! j's; hence: 



(M2-)) P/2 < (3 o< max_ i m^(^)) P/2 < 3^ 2 ]T K(W nJ )) p/2 , 
and (|33j) yields: 

OO 

]T(M2-")) p/ Vp/ 2 <+oo. 
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Hence, setting: 

(3.4) 7n= E (M2- fc )) P/2 2 fe ^ 

n/2<k<n 

we have: 

(3.5) lim 7n = . 



Now, by using [5], Theorem 4.19, we get a constant C > such that, for 

k < n: 

C P4 ,(2- k ) > 2 n - k P4 ,(2- n ), 

and so: 

(3.6) C "^>(nm(eiSZl)"\ 

To finish the proof, it remains to consider, for every h 6 (0, 1/2), the integer 
n such that 2~ n ~ 1 < h < 2""; then (EH) and GSM give: 



£ „(«ffl)- M1/ ^„, 

as announced. □ 
Remark. We can also deduce Corollary 13.21 from the following result. 



Proposition 3.5 If ji is a (3-Carleson probability measure on D, with f3 > 2, 
then the Poisson integral V: L 2 (T) — > L 2 (n) is in the Schatten class S p for any 
p> 2/09-1). 

Proof. We may assume that p < 2 since S Pl C S P2 when p\ < pi- To have 
V € S p , it suffices then to have J2 n ez II^C 6 ™)!!^^) < +°°) where e n {e lt ) = e mt 
(see [4], Proposition l.b.16, page 40, for example). 

But (Ve n )(z) = z n for n > and (Te n ){z) = zW for n < -1. Hence: 



OO „ 



n=0 

But 

\z\ 2n dfi= [ 2nt 2n - 1 P (\z\>t)dt 
l 



p/2 







2n / (1 -a;) 2 "-V(kl > 1 - x) dx 
o 



71 / (1 -sr^-a^cte 
Jo ^ 

since {\z\ > 1 — x} can be split in 0(l/x) windows W(a, x) 
{I - xf^x - 1 dx <n.n-P . 



n 



o 
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Hence 

nez n>l 
which is finite since (/3 — l)p/2 > 1. □ 



3.2 A general contruction 

In this subsection, we are going to describe a general way to construct sym- 
bols with some prescribed conditions. A particular case of this construction has 
been used in [5], Theorem 4.1. We also shall use it in [6]. 

Let 

OO 

/(*) = ^OfcCOs(fci) 

k=n 

be an even, non-negative, 27r-periodic continuous function, vanishing at the 
origin: /(0) = 0, and such that: 

(3.7) / is strictly increasing on [0,7r]. 

The Hilbert transform (or conjugate function) Hf of / is: 

OO 

fe=l 

We shall assume moreover that, as t tends to zero: 

(3.8) {Hf)\t)=o{l/t\ 

Let now F: O — > II + = {9\e z > 0} be the analytic function whose boundary 
values are 

(3.9) F*{j t ) = f{t)+iHf{t). 
One has: 

OO 

F(z) = ^a fc z fe , |z|<l. 

fc=0 

We define: 

(3.10) $(z) = exp ( - F(z)) , zeD. 
Since / is non-negative, one has 

KeF(z) = -^ J f(t)P z (t)dt>0, 

so that \&(z)\ < 1 for every z £ D: $ is an analytic self-map of D, and |$*| = 
exp(— /) < 1 a.e. . Note that the assumption /(0) = means that 3>*(1) = 1; 
we then have ||$||oo = 1, which is necessary for the non-compactness of C<j>. 
An example is $(z) — exp ( — (1 — z)/2\, for which f(t) = sin 2 (£/2). 
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Lemma 3.6 Assume that f and Hf are C 1 functions. Then, the Carleson 
function p$ of <I> is not o (h) when h goes to 0, and so the composition operator 
C$ : H 2 — > H 2 is not compact. 

Note that the hypothesis of the lemma holds, for example, when: 

oo 

(3.11) ^fc|a fc |<+oo. 

fe=0 

Proof. The non-compactness of C$ follows immediately from the "angular 
derivative" condition ([H], Theorem 3.5: see l|4.5p in the remark at the end of 
the next section). But we shall give a proof using the Carleson function, in 
order to illustrate the methods to be used later on. 

It will be enough to minorize /j,$[W(l, h)}. Since / and Hf are C , we have 
\f(t)\ < C\t\ and \Hf{t)\ < C\t\ for some positive constant C. Now, if \t\ < h/C, 
we see that 

|$*(e")l = e~ /(t) > e~ c|t| > e-' 1 >l-h, 

and |arg$*(e lt )| = \Hf(t)\ < C\t\ < h; hence $*(e i4 ) G W(l,h). This means 
that 

m^[W(l, h)) > m({e lt ; \t\ < h/C}) > ^- h, 

irC 

and the lemma follows. □ 



We shall now perturb $ by considering 

(3.12) M(z) = exp ( - , |z|<l, 
and 

(3.13) <p(z) = M(z)$(z), |z|<l. 
One has: 

(j>*(e u ) = e" /(t) e -^ H f( t )+ cot I). 

We will now, according to the various choices of /, study the behaviour of 
4> with respect to the Carleson windows. 

We set: 

(3.14) l{t)='Hf{t)+ C ot t - = - t +r{t), 

where the derivative of the odd function r satisfies r'(t) = o (l/t 2 ) . 
Now, we have: 

Lemma 3.7 When h > goes to 0, one has: 

(3.15) hf- i (h)< P ^h)<hf- i (2h). 
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Proof. Let a = e 10 e T, \6\ < ir. We may assume that < ft < h < 1/2, for 
some ho small enough. 

We have to analyze the set of t's such that 0*(e~ lt ) = e^We^W e W(a, h), 
which imposes two constraints. Without loss of generality, we may analyze only 
the set of positive t's, i.e. < t < n. 

Modulus constraint. We must have |(/>*(e -J *)| > 1 — ft,, i.e. e~^^ > 1 — h, or 
/(*) — 1°S \zrfi i which is < 2ft since h < 1/2. Hence we must have: 

(3.16) < t < f~ 1 {2h). 

Argument constraint. We must have \^{t) — 9\ < h mod 2n, i.e., since we 
have assumed that t > 0: 

(3.17) 7(t) S \J[0-h + 2nn, 6 + h + 2nn] = [j J n (h). 

n>0 n>0 

Since 7(<) — > +oo as t A 0, and since we already have t < f~ 1 {2h) by p,16p . we 
know that j(t) > 2ir for ft small enough; hence we have 7(<) € J n {h) only for 
Ji > -^/i! where the integer Nh goes to infinity when ft goes to 0; in particular, 
we may assume that, for ft small enough, we have j(t) e J„(ft) for n > 1 only. 

Let 7„(ft) = 7 - 1 (j„(ft)). Since j(t) = j + r(t), and r'{t) = o(l/t 2 ), 7 (i) is 
decreasing for < t < ho, for fto small enough. Hence, for h small enough: 

I n (h) = [7- 1 (0 + ft + 2n7r), 7 - 1 (0-ft + 2mr)]. 

Since j(t) = f + o (1 /*) and |y(i)| = Jr + o(l/i 2 ), one has: 

(3.18) — < mm/„(ft) < max I n (h) < — , 
n n 

where c\ and C2 are two universal positive constants. By the mean-value theo- 
rem, we get that: 

2nm(l„(h)) = 7~ 1 (6> - ft + 2mr) - 7~ 1 (<9 + ft + 2mr) 

= 2ft|(7- 1 )'fe)| = ^ ¥) 

|7 [tn)\ 

for some € J n {h) and t„ € I n (h), But, (|3 . 18[) ensures that 77 < i n < ff and, 
since |7'(t)| = ^ + o(l/i 2 ), we get that: 

(3.19) m(l n (h)) m 4' 



Now: 

1) Assume that 0*(e~ lt ) € W(a,/i). By (032]), (|318jl and (|316j) . we must 
have i e 7„(ft) with ^ < t < f~ l (2h). Hence, if no is the integer part of f-u 2 h) > 
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we must have n > uq. Now, Q3.19P shows that: 

m({t G]0,7r]; <f (e"*') e W{a,h)}) < £ m(l n (h)) 

n>no 
n>no 

2) We want to minorize, as it suffices, m[{t g]0,tt] ; </>*(e 1 *) € W(l,/i)}). 
Let m be the integer part of f-i 2 ^ + 1; we have: 

(3.20) te |J i n (h) ct>*{^)eW{i,h) 

n>ni 

because t S I„(/i) for n > ni implies i < ^ < so that |<^*(e l *)| = 

e -/(*) > e -ft > 1 — ft, and the modulus constraint for 4>*(e lt ) is automatically 
satisfied. Since the argument constraint is satisfied by construction, as t belongs 
to some J n (ft), this proves (|3.20|1 . 

As a consequence, we have, using (|3,19p : 

p*(h) > m*{WQ.,h)) > ]T rn(l n {h)) > ]T A > A > ft/-i(ft), 

n>ni n>ni 

and this ends the proof of Lemma [3~7l □ 



4 Composition operators with symbol of same 
modulus 

J. Shapiro and P. Taylor (|13|. Theorem 3.1) characterized Hilbert-Schmidt 
composition operators on H 2 (i.e. S S2), and this characterization 
depends only on the modulus of 4>* on <9B. It follows that if <j)\ and 4>2 axe 
two symbols such that \(j>\\ = j^l, and C^ 2 is Hilbert-Schmidt, then C t p 1 is also 
Hilbert-Schmidt, and in particular, compact. 

It appears that this is a limiting case, as we shall see in Theorem 14.21 

Actually, in view of Corollary 13.21 we may formulate this problem in the 
following way. Assume that the composition operator C ( p 1 is not compact on 
H 2 , and that |0*| = |<^||; for which values of a, can m^ 2 be an a-Carleson 
measure? 

Note that if m<p 2 is an a-Carleson measure, we necessarily must have a < 2. 
Indeed, if a > 2, Corollary 13.21 implies that C<p 2 £ S2, and hence C<p 1 E S2 as 
well. 

When a < 2, the situation is very different, and one has: 

Theorem 4.1 For every a with 1 < a < 2, there exist two symbols 4>\ and (j>2 
having the same modulus on <9B and such that p^ >1 (h) ss ft, but p<p 2 (h) ~ h a . 
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It follows from Corollary 13.21 that: 

Theorem 4.2 For every p > 2, there exist two symbols <p\ and 02 having the 
same modulus on 81} and such that C < p 1 is not compact on H 2 , but is in 
the Schatten class S p . 

Proof of Theorem l4.1L In [5], Theorem 4.1, we proved a particular case of this 
result, corresponding to a = 3/2. We took there 4>i{z) = . This function 
behaves as exp ( — [sin 2 (i/2)] + iTt[sm 2 (t/2)]) , and to prove Theorem 14.11 we 
shall just change the power 2 of sin(i/2). 

We shall use the following lemma, whose proof will be postponed. 
Lemma 4.«i For < f3 < 2, let f(t) = | sin ±f. Then: 

OO 

f(t) = c + ^2 c k cos kt , 

k=l 

with: 

(4.1) c k < for all k > 1; 

and 

(4-2) Ck = °(w+r)- 

In particular, for /3 > 1, the series J2k>i ^ c k is convergent, and J2k>i ^ c k < 0. 

Taking = ^-j- , which is > 1, and f(t) — |sin(t/2)| /3 as in Lemma l4~3l 
observe that / satisfies the assumptions p. lip and Q3.7P of the general con- 
struction of the Subsection 13.21 (note that for (3 > 2, / is a C 2 function, and 
hence, we have (|3 . 1 1|) directly, without using Lemma l4~3|) . With the notation 
of that subsection (see (|3~9j) . {3T0]) . and JHHSJ), set: 

(f>i = $ and 4> 2 = M$. 

One has: 

10*1 = 1 02 I a - e - 

Lemma [3~6l and MacCluer's theorem show that Cfa is not compact on H 2 . 
On the other hand, since ~ h 1 ^ , Lemma l3~7l shows that p^{h) « ft-", 

with a = 1+ i €]1,2[, 

That ends the proof of Theorem 14.11 □ 

Proof of Lemma l4.3L Before beginning the proof, it should be remarked that 
for (3 — 2 {i.e. a = 3/2, which is the case processed in (5], Theorem 4.1), we 
have a trivial situation: sin 2 | = \ — | cos£. 
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Proof of l|4.ip . For < p < 1, we have the well-known binomial expansion, 
for -1< x < 1: 



with: 



C\k = 



fe=i 

P(l -p) ■ • ■ - 1 ~P) 



k\ 



> 0. 



Taking x — cost and p = 13/2, we get: 



sin- 



= 1 — 2_. o-k{cost) k 



k=l 



(4.3) 2 13 ' 2 
Now, we know that: 



{cost) k — 2_, bj,k cos(fc — 2j)t , 
3=0 

with bj t k > 0. Substituting this in (|4,3p . grouping terms, and dividing by 2 /3 / 2 , 
we get l|4.ip . 

Proof of 1021). We shall separate the cases /3 = 1,0</3<1, and 1 < (3 < 2. 
For /9 = 1, one has, in an explicit way: 



i 

sin - 
2 



2 4 x - cosfci x - 

/ 77^ 7 = Co + > c fe cos fci . 

7T 7T ^— ' 4fc 2 - 1 ^ 

fc=l 



fc=l 



Assume < /? < 1. Since ^jj^- > on [0,7r], we can write: 



/smt/2\P „ 9 , . 



t/2 

where u is a C°° function on [0,7r], Then: 

c k = — =- / t p cos kt dt + —3- / t^uit) cos kt dt. 
2 p it Jo 2^% Jq 

The second integral is 0(k~ 2 ), as easily seen by making two integrations by 
parts. The first one writes: 



cos kt dt 



(3 r 



^ _1 sin ktdt 



[ k * fx 



■x\P~ 1 . dx 
sin x —— 

;/ k 

+00 

x®~ x sin a: dx. 
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This last integral is convergent and positive. Hence, since (3 + 1 < 2: 

where S is a positive constant. 

Before continuing, let us observe that we have similarly, due to the vanishing 
of the integrated terms: 

(4.4) f (sin^) CT sin(2fc + l)^^ = 0(fc~ (cr+1) ) + 0(fc- 2 ) = 0(fc- (CT+1) ), 
J Q \ 2/ 2 

for < a < 1. 

Assume now 1 < (3 < 2. We have: 



f(t) cos kt dt 



if (sin( * /2)) 



& Jo 



/'(i)sin fcicft 



/3-1 



cos(t/2) sin(fct) <it 



4fc 



(^sin-J sin(2fc + 1)- 



/ (sin-) sin(2fc- I)- dt 
Jq V 2/ 2 



= i ( fc -/5) = (fc-(/5+l) )j 
fc 

in view of 14.4^ applied with cr = — 1 e]0, 1[. 
This ends the proof of Lemma [4751 



□ 



Remark. The following question arises naturally: does £ S p for some 
p < co imply that is a-Carleson for some a > 1? We shall see in the next 
section (Remark 2 after the proof of Proposition l5.3|l that the answer is negative. 

Another question, related to our work, has been raised by K. Kellay: given a 
compact composition operator C$: H 2 — > H 2 , and another symbol i/j: D — * D, 
is the composition operator : H 2 — > i? 2 still compact? This is the case if 
(jnj) is univalent. In fact, the compactness of C$ implies Theorem 3.5) that: 

, s , 1 — 10(^)1 

4.5 lim - '7/' = +oo; 

hence, since |^)(^)'0(z)| < |</>(z)l f° r every z 6 1, we have: 

lim i_Mf^M = +00 , 

which implies the compactness of C^, thanks to the univalence of (fyip (|11|. 
Theorem 3.2). 
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In [5], Proposition 4.2, we proved a related result: let 4>\ , 02 ■ B — > B be 
univalent analytic self-maps such that |0*| < |02*| on dO; if C0 2 : i/ 2 — > H 2 is 
compact, and 02 vanishes at some point a G B, then : if 2 — > i? 2 is also 
compact. Note that the vanishing condition for 2 in that result is automatic 
(since 02 must have a fixed point a £ B because the composition operator C0 2 
is compact, see (XT], page 84, § 5.5, Corollary), but the univalence condition for 
4>\ and 4>2 cannot be dropped. In fact, take 4>\{z) = exp ( — (1 — z)/2) and 
2 (z) = zM(z) exp ( - (1 - z)/2) (where M(z) is defined by pTT2j) ). One has 
|0*| = 1 05 1 on SB, and 0i is univalent (if 4»i{z) = 4>i(w), k = is the only 
integer such that § — ^ = 2/c7ri, since |z| + |w| < 2). But 0i is the function $ 
defined by ([310]) . with /(i) = sin 2 (t/2). Since / and Hf are C 1 , LemmaEH 
says that C r p 1 is not compact. On the other hand, one has /~ 1 (/i) ~ h 1 / 2 , so 
Lemma [3/71 gives the compactness of (and even, € 5 P for every p > 4, 
by Corollary |3T2|) . 

It should be pointed out that, however, 0i cannot be written 0i — foip for 
some analytic self-map tp : B — > B. 

5 Composition operators in Schatten classes 

In [13], Theorem 4.2, J. Shapiro and P. Taylor constructed a family of com- 
position operators C$ g : H 2 — ► i? 2 , indexed by a parameter 6* > such that 
Ctf, e is always compact, but C^ e is Hilbert-Schmidt if and only if 6* > 2. In this 
section, we shall slightly modify the symbol 0#, and shall study the membership 
of Cfo in the Schatten classes S p . In [6], we study on which Hardy-Orlicz spaces 
if* these composition operators Cj, e are compact. 

Theorem 5.1 For every po > 0, there exists an analytic self-map 0: B — > B 
smc/i i/iai i/ie composition operator : H 2 — > if 2 is m £/ie Schatten class S p 
for every p > po, but not in S po . 

Proof. We shall use the same function as J. Shapiro and P. Taylor in [13], § 4, 
with slight modifications. This modified function will be easier to analyze. 
Let 6 > 0. 

For 9\e z > 0, logz will be the principal determination of the logarithm. Let, 
for e > 0: 

(5.1) V £ = {z G C; Ulez > and \z\ < e}. 
and consider, for e > small enough: 

(5.2) / e (z) = z(-logz) e , zeV £ . 

Lemma 5.2 _For £ > small enough, one has 9te fe(re la ) > /or < r < e 
and \a\ < ir/2. Moreover, one has *Refg(z) > for all z G dV e \ {0}. 

Proof. Actually, fg can be defined on V £ \ {0}, and we shall do that. 
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Let, for \a\ < it/2 and < r < e: 

Z a = (-\og(re ta )) 6 = (log 

One has fg{re la ) = re M |Z Q |e iargZ °, so that: 

JRe f 9 (re ia ) = r \ Z a | cos(a + arg Z a ) . 

On the other hand, 

&rgZ a = — #arctan- 



log 1 /r 

Since arctanx > x/2 for < x < 1, we get, for < r < £ < e _Tr / 2 : 



(7 a 
la + arg Z„\ < \a\ ( 1 arctan 



log 1 jr 

2 lou. I //■ ^ 



Therefore, for < r < e and |a| < ir/2: 

mef e (re la ) > (cosT r )r(logi) e > 0, 
as announced in Lemma 15.21 □ 



Let now gg be the conformal mapping from D onto V e , which maps T = 3D 
onto dV £ , and with gg(l) = and g' e (l) = — e/A. Explicitly, gg is the composition 
of the following maps: a) a: z \~ * — z from D onto itself; b) z 1— > = 

Z+Z \i+iz~\^ ' f rom D onto P = {3m z > 0}; c) s:zh *J~z from P onto Q = 
{9iez > 0, 3m z > 0}; d) 7- 1 : z h-> ^ f rom Q onto V = {\z\ < l,<Rez > 0}, 
and e) fc £ : z ^ cz from V onto V e . 

Let: 

(5.3) (f)g = exp(-fg o gg). 

By Lemma [521 the analytic function 4>g maps D into D. Moreover, one has 
1^1 < 1 on <9B\{1}. 



Now Theorem l5.ll will follow from the following proposition. 

Proposition 5.3 With the above notation, C c f >e : H 2 — > H 2 is compact {or every 
8 > and, moreover, is in the Schatten class S p if and only if p > | • 

Hence, given po > 0, if we choose 0o = — , we get that is in S p if and 
only if p > po. □ 

Proof of Proposition [B"T3l The compactness was proved in [13], Theorem 4.2; 
indeed, setting hg = fgogg, J. Shapiro and P. Taylor used the symbol 4>g = 1 — hg 
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and proved that lim t _>o |0£/( ei *)l = +°°: see equation (4.4) in [13] (note that, in 
order to deduce the compactness from this equality, J. Shapiro and P. Taylor 
had to prove a theorem: Theorem 2.4 in [13], whose proof needs to use Gabriel's 
Theorem). Since our symbol is <pg — exp(-hg), and exp (fte(e i4 )) -> 1 as t -> 0, 
it follows that the derivatives have the same behaviour when t — ► 0. However, 
we are going to recover this result by another method. For convenience, we shall 
write the boundary values fg , g$, . . . of the different analytic functions fg,gg,. . . 
in the same way as the analytic functions, without the exponent *. 

Note that, by Lemma 1531 \(j>$\ is far from 1 when ge{z) belongs to the 
half-circle {ee ta ; \a\ < n/2}. Hence, we only have to study the case where 
■ lt ) = it, —e < t < e. Moreover, since fg(it) = it(log4r — £sgn(f)?) , one 



9e{e 
has 



\fe(it)\ 



1*1 (b^ 



so that \(j>${gg is far from 1 when t is away from 0. Therefore, it suffices 

to study what happens when t is in a neighbourhood of 0. 

Note also that gg is bi-Lipschitz in a neighbourhood of 1 (so gg(e lt ) ~ it 
when |i| < 7r/2), so we may forget it, and only consider the measure of the t's 
for which fg(it) belongs to the suitable sets. Moreover, for convenience, we only 
write the proof for t > 0. 



Since 



feiit) = it 



(5.4) 

one has: 
(5.5) 

(5.6) 

Now, we have exp 
(5.7) 



it(lpgi 
it(logi 



l - 



in/2 

logl/t 
iTrO/2 
logl/t ' " Vlogl/t 



1 



<logi 



feiit) w 
3m f g (it) w 

fg(it)) e W(e- ia , h) (0<a< 2tt) if and only if 

£Ke/e(i*) < h 
\3mfg(it) -a\< h. 



(5.8) 

But, when e~ ta 9^ 1, this cannot happen for h small enough (since t goes to 
as ft goes to 0). Essentially, we only have to consider the case e~ la — 1, 
for which one has: when t > goes to 0, \9\e fg(it)\ < \3m fg(it)\, and hence 
exp(-fg(it)) e W(l,h) if and only if t(\ogl/t) 6 < h, i.e. t< h/(\ogl/h) d . 
Actually, we cannot assume a = 0, and we have to be more precise, and must 
do the following reasoning. When (|5.7p is satisfied, one has t(\og l/t) 6 ^ 1 < h; 
then t < ft/ (log l/h) 8-1 and hence: 



<logi 



< 



ft 



(logl/ft)*" 



log 



= ft log 



1 
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It follows that the condition (|5,8|1 implies that: 
(5.9) 0<a<Mogi- 

Therefore condition l|5.8p implies that t(\ogl/t) e < hlogl/h, which gives: 

< ft log 1/ft ft 



(log 1/ft)* (logl/ft)*" 1 

i.e. i(logl/i) e_1 < ft: condition I|5.7J1 is satisfied (up to a constant factor for 
ft). 

Since, by H5.9J1 . condition l|5.8p is satisfied when a — h< t(\ogl/t) e < (a + h) 
and implies that —{a + h) < t(\ogl/t) 6 < (a + h), it follows that the set of t's 
such that (|5.7p and l|5.8p are satisfied has, since log (a + ft) ~ log ft, a measure 
«ft/(logl/ft) e . 

We then have proved that: 
(5.10) p^(h) 



(logl/ft)* 

Since p<p e {h) — o(h), MacCluer's criterion gives the compactness of C^g. 

Now, we shall examine when C$ g is in the Schatten class S p , and for that we 
shall use Luecking's theorem (Theorem 13. ip . We have to analyze the behaviour 
of 4>e with respect to the Luecking sets R n ,j', actually, for convenience, we shall 
work with R' n j = R n ^-x-j. 

We have to consider the modulus and the argument constraints. 

Modulus constraint. The condition | < 9te /#(«£) < ft writes: 

h / 1 \ e-i 
(5-11) 2~V° g l) 

and reads as: 

ft/2 < < ft 
(5 " 12) (logl/ft)*" 1 ~ ~ (log 1/ft)"- 1 ' 

or, when ft = h n = 2~ n : 

n — (t»+1) 2~ n 

( 5 - 13 ) 7 TTfl — r J$ ^ ~ ~ e~T' 



More precisely, one must have t G I n — [a n , b n ], with a n ~ S^xu^i > ^r? 
and IJJ 



2" 



Argument constraint. We are looking for the set J n of the indices j = 
0, 1, . . . , 2" — 1 for which we have exp ( — fe{it)) S -R^.j- We have must have 
both the modulus constraint t <G /„ and: 

(5-14) jh n <t(log\) e < (j+l)h n , 
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which implies, for j > 1, since one has i|5.1ip : 



J<log-<2(j + l), 
and hence, by ([512]) and |5TT3| : 

Ti 

2 log2 < j <nlog2, 

i.e. j « n. The constant coefficients are not relevant here, and hence this 
estimation means that j can only take 0(n) values. 

On the other hand, when the modulus constraint l|5.1ip is satisfied, one has 
log(l/f) w \og(X/h n ), and the argument constraint (|5- 14|) is equivalent, with 
h = h n , to: 

jh K K (j + l)h 
(logl//i) e (logl/fc)' 

The length of the corresponding interval is w /i/(log(l//i)) 9 , which is equal, 
when h = h n = 2-", to 2~ n /n e . 

It follows hence that m^ e (iJ' •) » 2~ n /n e for exactly O(n) values of j, and 
otherwise m ( p e (R' n j) — 0; therefore: 

n—0 j—0 n—l n—l 

which is finite if and only if -# — 1 > 1, i.e. p > A/9. □ 

Remark 1. Proposition 15.31 shows that, for these symbols </>#, the necessary 
condition l|3.2p of Proposition 13.41 is not sharp; in fact, we have proved in (|5. 10|) 
that p(j,g{h) s» h/(\ogl/h) ; hence l13.2[) gives 8 > 2/p when C^j € 5 P , even 
though we must have 9 > 4/ 'p. 



Remark 2. These composition operators answer negatively the question asked 
at the end of Section [H since, by <|5. 10|) . the measure m$ e is a-Carleson for no 
a. > 1, though C(f, B is in S p for every p > 4/6. 



Remark 3. Our proof of Theorem 14.11 fails when a = 2 (i.e. /3 = 1). However, 
we are going to see that in this case, the composition operator of this 
Theorem 14. II is in S p for every p > 4. 

Indeed, for = 1, one has, in an explicit way: 



t 

sin- 



2 4 ^> cos kt 



IT IT * — ' 4fc 

fc=l 



co 



Cfc cos fci , 



fc=l 



with c fc = 0(fc" 2 ). Then: 
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, , v—* sin kt 1 , , 

w/(*) = Eiife2ri = 4 u ( i ) + «(*). 
fc=i 

where: 

oo . . 

fe=i 

and v is C 2 , since v(k) = 0(fc -4 ). We have: 

u'(t) = — = -log(2sin-J , 0<t<7r, 

k=l 

(note that u £ Lipl, but u is in the Zygmund class). It follows, when t > 
goes to zero, that: 



H/(t)«-t log (2 sin!) ratbgi- 



Since the modulus of continuity oiHf at is « ilog(l/t) (see also [16], Chapter 
III, Theorem (13.30) for a general result), it follows that the argument condition 
on 0i is |t| < i og (i/ fe ) and that (h) = Q( log ^ /fe) ). Then is compact. It is 
actually in S p for every p > 4. In fact, when t > goes to zero, sin(t/2) ~ t/2, 
and hence, with the notation of the Subsection 13. 2^ one has |3>*(i)| ~ t, whereas 
arg w i/log(l/t). We have then the same conditions as in the proof of 

Proposition 15.31 when 9=1, Hence C < p 1 € S p for every p > 4. □ 

Remark 4. We shall characterize in [6] the Orlicz functions \& for which these 
composition operators are compact. 

In Theorem 15. 1\ we get, for any po > 0, a composition operator which is in 
S p if and only if p > po . We can modify slightly this operator so as to belong 
in S p if and only if p > p . 



Theorem 5.4 For every po > 0, there exists an analytic self-map 4>: D — > B 
such that the composition operator : H 2 — ► H 2 is in the Schatten class S Po , 
but not in S p , for p < pa. 

Proof. We shall use the same method as in Theorem 15 .![ but by replacing the 
function fe by this modified function: 

(5.15) fg{z) = z(- \ogz) e [log(- log z)] \ 

where q > 9/2 (q = 9, for example). 

Call <j)0 the corresponding self-map of D. 

We shall not give all the details since they are mostly the same as in the 
proof of Theorem 15.11 

We have first to check that: 
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Lemma 5.5 For e > small enough, one has fRefg(z) > for every z G V £ . 
Moreover \cf>g\ < 1 a.e. on dH>. 

Proof. Write z — re M with < r < e and |a| < tt/2. One has: 
fe(z) = re ra (logi - iaj ( log ( log ~ - . 



But: 

( log- 

and, on the other hand 
(5.16) 

1 



(*;)' 



iaO 



logl/r \(logl/r) 



log ( log ia ) = log W ( log - ) + a 2 + i arg 



1\ 2 



(log- 

V r 



ict 



flog log-) (l + o(l/log(l/r))) - i arctan - 
\ r J log 1/r 

( log log I) (1 + o (1/ log(l/r))) - (1 + o (1)) , 



and 
(5.17) 



log ( log - 



— ia. 




i)« 




r J 








ly 


1 


r ) 





1 + 

Hence, for e > small enough: 

mefe(z) = r(logl/r) e (loglogl/r)« 
> r(logl/r) e (loglogl/r) 9 



f— , • 

V log 1/r / \ log 1/r log log 1 jr 

1 

logl/r 



(a« + o(l)) 



0q sin a 
cos a + ; h o 



1 



cos a 



log 1/r V log 1/r 
?(asina — 1/4) 



log 1 /r 



That gives the result since, on the one hand, \9(asm.a — l/4)/logl/r| is < V2/A 
for e > small enough and cos a > V2/2 when \a\ < n/4, and, on the other 
hand, when \a\ > n/4, one has 



cos a + 8(a sin a — 1/4) > 0(tiV2/8- 1/4) > 0. 

That ends the proof of the lemma. 

Now, by (|5.16p . for t > going to zero: 



□ 



log f log 



1 .7T 

t ~ l 2 



log log - + O 



(log*) 5 



logl/t> 
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Therefore: 



3m 



log(logi-i| 
log(logi-i| 



log log -J 
(log log 



log 1/f 



and, using (|5.4p (or (|5.17p . with a = 7r/2), we get: 



/fl(it) ««(log-) 
/«(«)« t(logi)'( 



In e (log log 1 /i) « 



log 1/f 



V og t) C loglog i; 



log log 



1\« 



Hence the modulus constraint gives, with h = h„ = 2 " : 

5.18 i« n-, —r, 

{\ogl/h) 6 '(loglogl/ft) 9 
and the argument constraint: 

1\9 



/ 1 

jft<t(^log-J ^ log log - 



< 



0' + !)ft- 



One gets: 



and: 



i » log 



log- 



m iS R 'n. 



2 -n 



06 " J (logl//i) e (loglogl//i) 9 n e (logn)« 
It follows that Luecking's criterion becomes: 

2 — 2 



E 



i 



n 9p/2(l ogn )9p/2 ^ n e P/ 2 ~ 1 (logn)'?P/ 



This series converges if and only if p > 4/9 or else p — 4/ '6, since then 
qp/2 = q(4/e)/2 = q/(9/2) > 1. Hence e S p if and only if p > 4/0, and 
that proves Theorem 15.41 □ 



In [TJ, T. Carroll and C. Cowen showed that there exist compact composition 
operators on H 2 which are in no Schatten class S p for p < oo (see also [15] and 
[3]). We shall give an explicit example of such an operator. 

Theorem 5.6 There exist compact composition operators C^: H 2 — > H 2 which 
are in no Schatten class S p with p < oo . 
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Proof. The proof follows the lines of those of Theorem 15.11 and Theorem 15, 4^ 
but with, instead of fe or fg: 

(5.19) f(z) = z\og(-logz). 

For £ > small enough, we have £He f(z) > 0, so that the corresponding function 
<f) sends D into itself; moreover, one has \cf)*\ < 1 a.e. on 83. Indeed, if z — 
re la € V e , then — log z — R e lf3 , with 



R = ^(logl/r) 2 +a 2 = log(l/r) + o (log 1/r) 

(3 = -arctan- — — = -- — — - + o (1/ log(l/r)) . 

log 1/r log 1/r v ' 

Then log(- logz) = \ogR + i{3 = (log R)(l + M and 



me f(z) = r(log R) ( cos a - 



But 

(3 sin a 



cos a ; = cos a 



log J? (log 1/r) (log log 1/r) 



(l/(logl/r)(loglogl/r)) 

and we see, as in the proof of Lemma T5.5I that this quantity is, for e > small 
enough, greater than a positive constant, uniformly for \a\ < n/2. 

Now, one has, as above, for t going to zero: 
Kef (it) ~ 1/1 



log l/|t| 

1 



dmf(it) « iloglo b 

It follows that is compact since p<j,(h) « ft/ log log 1/ft: indeed, we have to 
control the two conditions: 

(5-20) < - IjL , < ft 

V ^ log ~ 

(5.21) a-/i<*loglog|-j <a + /i, 

r I 

for < a < 27r. When a 9^ 0, condition (|5.21|) cannot happen for ft, small 
enough, because of condition (|5 .20(1 : more precisely, (|5.20p and (|5.21|) imply 
that 

(5.22) < a < ft + ft log ~ log log ~ < ft log ~ log log ~ , 

ft ft ft ft 



and then l|5.2ip implies: 



-ft < * log log < ft log i log log i ; 
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a fortiori: 

1*1 log log < ft log - log log - , 

and then: 

\t\<hlog~ 

Therefore condition (|5.21|) implies condition (|5 .20(1 . Since, (|5.22|) implies that 

log(a + ft) w log ft, 

we get that the measure of the t's satisfying (|5.21[) is » ft log log 1 /ft: l|5.2ip is im- 
plied by —ft < t log log l/|t| < a + h and implies that — (a + h) < f log log l/|t| < 
(a + h). 

Hence, we have got that p,p(h) « ft/ log log 1/ft, showing that C$ is compact. 
By Proposition 13, 4} is in no Schatten class S p , p > 0. 
In order to make more transparent the behaviour of the measure m^, we 
shall give a direct proof, using Luecking's criterion. 

For testing Luecking's criterion, we must have, assuming t > 0: 

t w ftlogi 
h 

and: 

jh <i log log- < (j + l)ft, 
so j « log 1/ft log log 1/ft « nlogn, and: 

ft 2~™ 



log log 1/ft logn 
Therefore Luecking's condition becomes: 

00 T / O-np/2 \ "1 v 



J (logn)f/ 2 - 1 



It follows that £ S p . □ 
As a corollary, we get: 

Theorem 5.7 There exist two symbols (f> and ip of same modulus \<j>*\ = 

on T such that C$ is compact on H 2 , but in no Schatten class S p for p < oo, 

whereas is in S p for every p > 2. 

Proof. Set 

ip = <j>M, 

where 4> is the function used in Theorem l5,61 and M is the singular inner function 
given by (|3. 12|1 . Since Die f (it) i/log(l/i), Lemma I37F1 gives, if one sets 
/(t)=t/log(l/t): 

p^(ft)«ftr l (ft)«ft 2 io g (i/ft). 
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It follows that m^p is an a-Carleson measure for any a < 2. Hence, given 
any p > 2, and choosing an a < 2 such that p > 2/ (a — 1), it follows from 
Corollary 1331 that C,/, € S r . □ 



A funny question about Schatten classes is: for which Orlicz functions \& is 
the above composition operator in the Orlicz-Schatten class 5*? 

6 Questions 

We shall end this paper with some comments and questions. 

1. G. Pisier recently suggested that one should study more carefully the 
approximation numbers of composition operators. Since an operator T on a 
Hilbert space is in the Schatten class S p if and only if Y^n=i a n < +°°, where 
a n is the n th approximation number of T, our present work may be seen as a, 
very partial, contribution to that study. 

Note that Luecking's proof of its trace-class theorem does not make explicit 
mention of singular numbers, but relies instead on an interpolation argument. 

2. It is clear, by our results, that the membership in S p for the composition 
operator cannot be characterized in terms of the growth of the Carleson 
function p$. But we have given a sufficient condition in Corollary 13. 2^ and a 
necessary one in Proposition 13.41 Are these two conditions sharp? Can they be 
improved? 

3. Do there exist two symbols 4>\ an d 4>2 having the same modulus on dH> 
such that Cfa is not compact on H 2 , but C0 2 is in S p for every p > 2? 

4. (K. Kellay) If : H 2 — ► H 2 is compact (or even in S p , with p > 2) and 
tp: D — > ED is analytic, is C^, : H 2 — > H 2 compact? 
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